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ABSTRACT 

Objectives To assess the benefits and harms of 
reboxetine versus placebo or selective serotonin reuptake 
inhibitors (SSRIs) in the acute treatment of depression, 
and to measure the impact of potential publication bias in 
trials of reboxetine. 

Design Systematic review and meta-analysis including 
unpublished data. 

Data sources Bibliographic databases (Medline, Embase, 
PsyclNFO, BIOSIS, and Cochrane Library), clinical trial 
registries, trial results databases, and regulatory 
authority websites up until February 2009, as well as 
unpublished data from the manufacturer of reboxetine 
(Pfizer, Berlin). 

Eligibility criteria Double blind, randomised, controlled 
trials of acute treatment (six weeks or more) with 
reboxetine versus placebo or SSRIs in adults with major 
depression. 

Outcome measures Remission and response rates 
(benefit outcomes), as well as rates of patients with at 
least one adverse event and withdrawals owing to 
adverse events (harm outcomes). 
Data extraction and data synthesis The procedures for 
data extraction and assessment of risk of bias were 
always conducted by one person and checked by another. 
If feasible, data were pooled by meta-analyses (random 
effects model). Publication bias was measured by 
comparing results of published and unpublished trials. 
Results We analysed 13 acute treatment trials that were 
placebo controlled, SSRI controlled, or both, which 
included 4098 patients. Data on 74% (3033/4098) of 
these patients were unpublished. In the reboxetine 
versus placebo comparison, no significant differences in 
remission rates were shown (odds ratio 1.17, 95% 
confidence interval 0.91 to 1.51; P=0.216). Substantial 
heterogeneity (l 2 =67.3%) was shown in the meta-analysis 
of the eight trials that investigated response rates for 
reboxetine versus placebo. A sensitivity analysis that 
excluded a small inpatient trial showed no significant 



difference in response rates between patients receiving 
reboxetine and those receiving placebo (OR 1.24, 95% CI 
0.98 to 1.56; P=0.071; l 2 =42.1%). Reboxetine was 
inferior to SSRIs (fluoxetine, paroxetine, and citalopram) 
for remission rates (OR 0.80, 95% CI 0.67 to 0.96; 
P=0.015) and response rates (OR 0.80, 95% CI 0.67 to 
0.95; P=0.01). Reboxetine was inferior to placebo for both 
harm outcomes (P<0.001 for both), and to fluoxetine for 
withdrawals owing to adverse events (OR 1.79, 95% CI 
1.06 to 3.05; P=0.031). Published data overestimated the 
benefit of reboxetine versus placebo by up to 115% and 
reboxetine versus SSRIs by up to 23°/o, and also 
underestimated harm. 

Conclusions Reboxetine is, overall, an ineffective and 
potentially harmful antidepressant. Published evidence 
is affected by publication bias, underlining the urgent 
need for mandatory publication of trial data. 

INTRODUCTION 

Reboxetine, the first selective norepinephrine (nora- 
drenaline) reuptake inhibitor used in the treatment of 
depression, 1 mainly acts by binding to the norepi- 
nephrine transporter and blocking reuptake of extra- 
cellular norepinephrine. 2 The drug is "indicated for the 
acute treatment of depressive illness or major depres- 
sion and for maintaining the clinical improvement in 
patients initially responding to treatment."' 1 Reboxe- 
tine has been approved for marketing in many Eur- 
opean countries (for example, the United Kingdom 
and Germany) since 1997. In the United States, how- 
ever, the application for approval was ultimately 
rejected after preliminary acceptance. 24 

Compared with the overall amount of anti- 
depressants prescribed, reboxetine's share is relatively 
small. For example, of 974 million defined daily doses 
of antidepressants prescribed in Germany in 2008, 
reboxetine accounted for 6.7 million defined daily 
doses. 5 The average cost of reboxetine per defined 
daily dose was€1.87 (£1.54; $2.39) forEdronax (Pfizer, 
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Berlin) to €2.09 for Solvex (Merz, Frankfurt), com- 
pared with €0.52 for selective serotonin reuptake inhibi- 
tors (SSRIs), the most commonly prescribed anti- 
depressants. 5 

Although reboxetine has been claimed to show 
superior efficacy to placebo and similar efficacy to 
other antidepressants, 16 10 the clinical relevance of the 
drug has been queried. A recent systematic review by 
Cipriani et al 11 included a network meta-analysis of 
active controlled trials and found that reboxetine was 
not only significantly less effective than the other 
newer antidepressants investigated, but was also the 
drug with the highest dropout rates. 

The German Institute for Quality and Efficiency in 
Health Care (Institut fur Qualitat und Wirtschaftlich- 
keit im Gesundheitswesen (IQWiG)) conducted a 
health technology assessment of the short term and 
long term benefits and harms of reboxetine, bupro- 
pion, and mirtazapine in placebo controlled and active 
controlled trials of adult patients with major depressive 
disorder. Both published and previously unpublished 
data were considered. The full German language 
report and an English summary are available on the 
institute's website. 12 13 The responsibilities and metho- 
dological approach of IQWiG are described in its 
methods paper online. 14 

This publication presents the main findings of the 
reboxetine trials with the aim of assessing the benefits 
(remission and response rates) and harms (rates of 
patients with at least one adverse event and rates of 
withdrawals owing to adverse events) of reboxetine 
versus placebo or SSRIs in the acute treatment of 
major depressive disorder. In addition, for the present 
paper we assessed potential publication bias by com- 
paring results from published and unpublished trials of 
reboxetine. 

METHODS 

We developed and followed a standardised protocol 
for all steps of the review. 15 

Eligibility criteria 

The health technology assessment report that formed 
the basis of this publication included both published 
and unpublished trials of reboxetine that had the fol- 
lowing characteristics: 

• Double blind, randomised controlled design 

• Investigation of adult patients with major 
depressive disorder as their primary diagnosis 
according to the International Classification of 
Diseases, the Diagnostic and Statistical Manual of 
Mental Disorders, or the Research Diagnostic 
Criteria 

• Acute treatment (at least six weeks duration) or 
long term treatment (at least six months (relapse) 
or 12 months (recurrence)) for prevention of 
relapse or recurrence 

• Comparison of reboxetine with placebo or any 
antidepressant (including St John's wort); 



treatment according to approval status in 
Germany 

• Evaluation of at least one prespecified patient 
relevant outcome (in this context, the term 
"patient relevant" refers to "how a patient feels, 
functions, or survives" 16 ) 

• Publication in English, German, or French (or 
any other language if the trial was classified as 
potentially relevant according to the English title 
or abstract) 

• Availability of a full text document (for example, 
journal article or clinical study report). 

This publication is limited to acute treatment trials of 
reboxetine versus placebo or SSRIs. The outcomes 
presented are restricted to the most commonly 
reported outcomes in depression trials. Benefit out- 
comes were remission and response rates. Harm out- 
comes were rates of patients with at least one adverse 
event (any adverse event according to the definitions 
used in the primary trials) and rates of withdrawals 
owing to adverse events (any adverse event according 
to the definitions used in the primary trials). Harms 
were further described by the overall rates of patients 
with serious adverse events (any serious adverse event 
according to the definitions used in the primary trials). 

According to the review protocol, response and 
remission data were analysed on the basis of the defini- 
tions and instruments used in the primary trials. All 
trials applied the Hamilton depression rating scale and 
10 trials additionally applied the Montgomery -Asberg 
depression rating scale. We primarily considered the 
response and remission outcomes on the Hamilton 
depression rating scale. In all trials, response was 
defined as a reduction in the score on the Hamilton 
depression rating scale of 50% or more from baseline 
to end of study, and remission was defined as a reduc- 
tion in the score on the Hamilton depression rating 
scale to below an absolute threshold at end of study 
(score <10 in all trials except in one trial where the 
score threshold was <8). 

Search strategy and study selection 

We searched for relevant primary and secondary pub- 
lications (systematic reviews and health technology 
assessment reports) in Medline, Embase, PsycINFO, 
BIOSIS, and the Cochrane Library published up 
until February 2009. The full search strategy, including 
the search terms used for the various databases, has 
been described elsewhere. 12 

We scrutinised the reference lists of the primary and 
secondary publications retrieved to identify further 
trials. In addition, clinical trial registries and trial results 
databases available on the internet were screened, as 
were the websites of the European Medicines Agency 
and the US Food and Drug Administration. 

In order to obtain the most complete dataset possi- 
ble, we asked the manufacturer of reboxetine (Pfizer) to 
supply unpublished trials and additional unpublished 
data from published trials. As a prerequisite for the use 
of unpublished data, IQWiG asked the manufacturer 
to sign an agreement requiring: (1) submission of a list 
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Records identified through database search (n=4347) 



Duplicates (n=1751) 



Records screened (after duplicates removed) (n=2596) 



Excluded (n=1883): 
Not relevant (n=1822) 
— Relevant systematic reviews and health technology 
assessment reports (n=45) 
Publications not available (n=16) 



Primary publications in patients with depression (n=713) 



Excluded primary publications of patients with 
depression (n=700): 
Inappropriate indication (n=65) 
Inappropriate intervention (n=172) 
Inappropriate control intervention (n=215) 
Not double blind randomised controlled trial (n=165): 
No randomised controlled trial (n=117) 
Not double blind (n=48) 
Duration too short (n=36) 
No relevant end points (n=2) 
Inappropriate language of publication (n=ll) 
No full publication (n=30) 
No re-randomisation (n=4) 



Studies identified from bibliographic databases 
(n=10 studies, 13 publications) 



Incompletely published studies (n=3) 



Studies provided by manufacturer (n=10): 
■« — Unpublished (n=7) 

Incompletely published (n=3) 



Published and unpublished studies (n=17) 



Excluded (n=4): 
— Relapse prevention trials (n=2) 

Tricyclic antidepressant controlled trials (n=2) 



Placebo controlled and selective serotonin reuptake inhibitor 
controlled studies (n=13): 
Included in qualitative synthesis (n=13) 
Included in quantitative synthesis (n=12)* 



Fig 1 1 Flowchart of study selection. *Excluding long term acute 
treatment trial 

of all sponsored published and unpublished trials 
investigating reboxetine; (2) submission of documents 
(generally the clinical study reports) compliant with the 
CONSORT criteria for all relevant trials selected by 
IQWiG; and (3) permission for publication of all pre- 
viously unpublished relevant data. This procedure was 
required to avoid bias through selective provision of 
data. Finally, people and parties who had submitted 
comments on the preliminary version of the health 
technology assessment report at the public hearing in 
July 2009 were asked to provide any additional rele- 
vant trials. 

Two reviewers independently screened titles and 
abstracts of the retrieved citations to identify poten- 
tially eligible primary and secondary publications. In 
a first broad screening step, citations were excluded if 
clearly irrelevant; that is, if a primary publication was 
not a clinical trial in humans with depression, or if a 
secondary publication of eligible trials was not a sys- 
tematic review. In a second screening step, the full set 



of eligibility criteria was applied. Potentially relevant 
articles were then screened as full texts. Disagreement 
was resolved by consensus. 

Data extraction and assessment of risk of bias 

The individual steps of the data extraction and assess- 
ment of risk of bias were always conducted by one per- 
son and checked by another. Details of the trials were 
extracted using standardised tables. Information and 
data from publications were supplemented by clinical 
study reports provided by the manufacturer. We 
always extracted data from the intention to treat popu- 
lations. Clinical study reports were always considered 
the primary source in instances of conflict with the pub- 
lication. Disagreement was resolved by consensus. 
Information was extracted from each included trial on: 

• Study characteristics, including citation, study 
design, setting (inpatient or outpatient), inclusion 
and exclusion criteria, length of follow-up, 
sample size, location, number of centres, and 
year of completion 

• Characteristics of the study participants, 
including age, gender, and disease severity at 
baseline 

• Characteristics of the test and control 
interventions, including dose 

• Outcomes and type of outcome measures 
(outcomes as presented above; measurement 
tools as used in the individual trials) 

• Risk of bias items. 

The risk of bias at the study level was assessed on the 
basis of the adequacy of the following criteria: rando- 
misation; allocation concealment; blinding of patients 
and investigators; and complete and non-selective 
results reporting. The risk of bias at the outcome level 
was assessed on the basis of the adequacy of: applica- 
tion of the intention to treat principle; blinding of the 
outcome assessor; statistical evaluation; and complete 
and non-selective results reporting. Trials and out- 
comes were categorised into those with a low risk of 
bias and those with a high risk. 

Data analysis 

If feasible and meaningful, data were pooled by means 
of meta-analyses. Effect measures were reported as 
odds ratios (ORs) and 95% confidence intervals (CIs) 
for binary data. A random effects model was used to 
calculate a pooled effect estimate. Statistical signifi- 
cance was assumed for P<0.05. Heterogeneity of effect 
sizes was assessed by using the I 2 statistic; pooled esti- 
mates were not calculated if substantial heterogeneity 
was observed (P>50%). If heterogeneity with P>50% 
was shown, sensitivity analyses were conducted, when 
appropriate, to assess possible sources of heterogeneity 
across the trials included. The review protocol prespe- 
cified potential effect modifiers, including gender and 
trial setting (inpatient or outpatient). These factors 
were investigated by means of random effects meta- 
regression analyses based on aggregate study data. 17 
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Table 1 1 Trial publication details 


Trial 


Year of 

r t\ m n 1 of i a n 

LUIIipiCLIUII 


PWmar\/ ni i hi ir :ati An ai/ailaKlo'? 
rllllldly {JUL! UldLIUM dvdlldUle! 


Clinical study report 

dvdlldUle I 


014 


Before 1996 


Refs 42-44 


Ref45f 


015 


1992 


None, only a pooled analysis (ref 6) 


Ref 46 


016 


1993 


Ref 47 


Ref 48 


032 


2001 


None 


Ref 49 


043 


2001 


Ref 50 


Ref 51 


045 


1999 


None 


Ref 52 


046 


2000 


None 


Ref 53 


047 


2000 


Ref 19, although the data for the full study 
population were not reported 


Ref 54 


049 


1998 


None 


Ref 55 


050 


1999 


Ref 20, although only data on sexual dysfunction 
and other adverse events were reported 


Ref 56 


052 


2000 


Ref 18, although the data for the full study 
population were not reported 


Ref 57 


091 


1990 


Refs 58 and 59 


Ref 60 


Berlanga and Flores- 
Ramos 2006 


2003 


Ref 61 


No 


*As a matter of principle, the German Institute for Quality and Efficiency in Health Care requests documents 
compliant with the CONSORT criteria from manufacturers on all relevant trials selected. If cooperative, 
manufacturers usually provide the full clinical study report; that is, a written description of the study that 
follows the guidelines of the International Conference on Harmonisation. 62 
fOnly addendum. 



To assess publication bias, effect sizes in the pub- 
lished, unpublished, and overall dataset were com- 
pared. In addition, the differences in effect sizes 
between published and unpublished data, and between 
published and overall data, were expressed as the ratio 
of odds ratios (ROR). The magnitude of the overesti- 
mation or underestimation of effect sizes in published 



versus overall data (publication bias) was expressed as 
percentage changes. 

Meta-analyses were performed using SAS version 
9.1.3. If meta-analyses were not possible, the results 
of the individual trials were assessed. 

RESULTS 

Study selection 

The process of study selection is presented in figure 1. 
The search in bibliographic databases yielded 2596 
citations, of which 713 were classified as potentially 
relevant and subjected to strict eligibility assessment. 
A total of 13 citations (10 trials) met the inclusion cri- 
teria; however, two of these 13 citations were publica- 
tions on subgroups of otherwise unpublished trials, 18 19 
and one was the only available publication on the total 
population being studied but did not report the main 
outcomes. 20 In the assessment of publication bias, we 
considered these three trials to be "unpublished." No 
trials were identified in clinical trial or trial results regis- 
tries or in the European Medicines Agency or FDA 
websites. 

The retrieval of previously unpublished trials was ham- 
pered by the fact that during preparation of the prelimin- 
ary health technology assessment report, the 
manufacturer of reboxetine did not provide a complete 
list of unpublished trials as requested by IQWiG. 21 22 Sec- 
ondary publications clearly indicated that further poten- 
tially relevant unpublished trials existed.'' 8 As the 
preliminary report showed that reboxetine had been 
tested in at least 16 trials including about 4600 patients, 
but data on almost two thirds of these patients were not 



Trial 


Reboxetine 


Placebo 




(n/N) 


(n/N) 


Remission 






014 


60/126 


34/128 


015 


47/110 


40/111 


046 


132/252 


124/247 


047 


109/238 


101/239 


050 


48/144 


54/143 


045 


30/88 


33/86 


049 


29/106 


27/104 


Total 


455/1064 


413/1058 


Total heterogeneity: I 2 


=49.0%, P=0.068; total effect: P=0.216 


Response 






014 


70/126 


43/128 


015 


65/110 


58/111 


046 


144/252 


136/247 


047 


120/238 


108/239 


050 


60/144 


63/143 


045 


38/88 


39/86 


049 


42/106 


35/104 


Total 


539/1064 


482/1058 


Total heterogeneity: I 2 


=42.1%, P=0.110; total effect: P=0.071 


091 


20/27 


5/25 




Weight 

(%) 



Odds ratio 
(95% CI) 



0.20 0.33 0.50 
Control better 



1 2 3 5 

Reboxetine better 



13 


2 


2.51 (1.49 to 4.25) 


12 


7 


1.32 (0.77 to 2.27) 


19 


1 


1.09 (0.77 to 1.55) 


18 


7 


1.15(0.80 to 1.66) 


14 


4 


0.82 (0.51 to 1.34) 


10 


8 


0.83 (0.45 to 1.54) 


11 


0 


1.07 (0.58 to 1.98) 


100 


00 


1.17 (0.91 to 1.51) 


13 


1 


2.47 (1.49 to 4.11) 


12 


3 


1.32 (0.78 to 2.25) 


19 


3 


1.09(0.76 to 1.55) 


19 


0 


1.23 (0.86 to 1.77) 


14 


4 


0.91 (0.57 to 1.45) 


10 


5 


0.92 (0.50 to 1.67) 


11 


4 


1.29(0.74 to 2.27) 


100 


00 


1.24(0.98 to 1.56) 



11.43 (3.10 to 42.12) 



Fig 2 1 Forest plot showing meta-analyses of remission and response rates for trials that compared reboxetine with placebo. 
Empty boxes show published studies and filled boxes show unpublished studies. Study 091 is not included in the pooled 
analysis of response of reboxetine versus placebo because of high heterogeneity (see text for details). CI, confidence interval; 
n, number of patients with event; N, number of patients in treatment group 
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Table 2 1 Trial characteristics and baseline demographics 



Baseline demographics 









of maximum 




Duration 










Hamilton 


Total 








approved 


Number of 


of active 


Number of 




Age 




depression rating 


disconti- 






Dose 


daily dose 


patients 


medication 


centres 




(mean 


Proportion 


scale 21 (mean 


nuation 


Trial 


Treatments 


(mg/d) 


(%) 


randomised 


(weeks) 


(locations)* 


Setting 


(SD)) 


female (%) 


(SD)) 


rate (%)f 




Reboxetine 


8-10 


67-83 


126 






Inpatient 


40 (12) 


67 


26.8 (3.4) 


30 


014 


Fluoxetine 


20-40 


25-50 


127 


8 


33 (Europe, South 
America) 


and 


40 (12) 


65 


26.9 (3.6) 


24 




Placebo 


— 


— 


128 




outpatient 


44 (12) 


54 


27.4 (3.6) 


41 




Reboxetine 


8-10 


67-83 


112 








46 (13) 


63 


27.5 (5.1) 


21 




1 mipram ine 


150-200 


1 npstisnt* 


115 






Inpatient 

and 
outpatient 


44 (11) 


67 


26.9 (4.7) 


33 


015 






50-67 
Outpatient: 
100-133 




6 


34 (North America, 
Europe, Australia) 












Placebo 






112 








43 (12) 


48 


27.1 (5.3) 


23 




Reboxetine 


8-10 


67-83 


79 




16 (Europe, South 


Inpatient 


44 (13) 


72 


28.6 (5.3) 


25 


016 


Fluoxetine 


20-40 


25-50 


89 


8 


America, 
Australia) 


and 
outpatient 


44 (12) 


72 


27.4 (4.1) 


23 




Reboxetine 


8-10 


67-83 


43 






Inpatient 


41 (15) 


63 


27.2 (5.4) 


35 


032 


Fluoxetine 


20-40 


25-50 


42 


8 


5 (Asia) 


outpatient 


36 (13) 


62 


28.3 (5.3) 


31 




Reboxetine 


8-10 


67-83 


183 




23 (Europe) 




43 (13) 


69 


27.4 (3.5) 


50 


043 


Citalopram 


20-40 


33-67 


176 


24 


Outpatient 


42 (12) 


60 


27.4 (3.9) 


31 




Reboxetine 


8 


67 


89 






Inpatient 


42 (11) 


63 


26.4 (2.6) 


30 


045 


Placebo 


— 


— 


87 


6 


48 (Europe, Asia) 


and 
outpatient 


41 (11) 


70 


26.4 (2.6) 


23 




Reboxetine 


8-10 


67-83 


265 








40 (1 1) 


71 


23.0 (5.5) 


25 


046 


Paroxetine 


20-40 


40-80 


265 


8 


94 (North America) 


N/A 


40 (12) 


69 


22.8 (5.4) 


2 2 




Placebo 






257 








39 (12) 


70 


23.0 (5.2) 


1 6 




Reboxetine 


8-10 


67-83 


2 58 








39 (12) 


74 


1 A 1 ( A Ol 


2 7 


047 


Paroxetine 


20-40 


40-80 


1 


8 


68 (North America) 


N/A 


40 (11) 


72 


23.9 (5.4) 






Placebo 






2 54 








37 (11) 




23.7 (4.8) 


23 




Reboxetine 


8-10 


67-83 


107 




9 (North America) 




40 (12) 


5 5 


25.1 (2.6) 


3 5 


049 


Placebo 






105 


6 


Outpatient 


40 (11) 


58 


25.3 (3.0) 


2 2 




Reboxetine 


8-10 


67-83 


150 








40 (11) 


63 


25.6 (3.4) 


42 


050 


Fluoxetine 


20-40 


25-50 


150 


8 


24 (North America) 


Outpatient 


41 (11) 


66 


26.0 (3.3) 


31 




Placebo 






150 








40 (11) 


60 


25.5(3.3) 


40 




Reboxetine 


8-10 


67-83 


159 




41 (Europe) 




42 (12) 


63 


24.2 (3.6) 


33 


052 


Paroxetine 


20-40 


40-80 


166 


8 


N/A 


45 (11) 


62 


24.1 (3.4) 


20 




Reboxetine 


10 


83 


28 




3 (North America, 




42 (N/A) 


46 


35.7 (N/A) 


14 


091 


Placebo 






28 


6 


South America) 


Inpatient 


40 (N/A) 


50 


35.1 (N/A) 


57 


Berlanga and 


Reboxetine 


4-8 


33-67 


46 








N/A 


N/A 


N/A 


10 


Flores-Ramos 


Citalopram 


20-40 


33-67 


55 


8 


1 (CentralAmerica) 


Outpatient 


N/A 


N/A 


N/A 


25 



2006 

*Details on individual countries are provided in web table A. 

fTo comply with the intention to treat principle, missing data from discontinued patients were imputed by using the last observation carried forward method. 
N/A, not available. 



accessible, the institute initially concluded that no mean- 
ingful assessment of reboxetine was possible. 2122 

After the publication of the preliminary report, the 
manufacturer decided to cooperate and provided most 
of the missing data (one venlafaxine controlled trial 23 
was not available as a full publication). Thus, an addi- 
tional 1 0 previously unpublished or incompletely pub- 
lished reboxetine trials were considered in the final 
health technology assessment report. 12 Two trials 
with tricyclic antidepressants as active controls and 
two relapse prevention trials were excluded from the 
present analysis. 

Of the remaining 13 eligible acute treatment trials, 
three were placebo controlled, five were active con- 
trolled, and five had both placebo and active 



controlled arms (one of which had a tricyclic anti- 
depressant arm that was not considered). A total of 
4098 patients were analysed: 2256 in the reboxetine 
versus placebo comparisons and 2641 in the reboxe- 
tine versus SSRI comparisons. 

Study characteristics 

The characteristics of the pool of 1 3 acute treatment trials 
that were placebo controlled, SSRI controlled, or both 
are presented in tables 1 and 2. All trials were sponsored 
by predecessors of Pfizer (Pharmacia, and Pharmacia & 
Upjohn), except for Berlanga and Flores-Ramos 2006 
(sponsored by Lundbeck), and included adult patients 
with major depressive disorder according to the third 
edition, revised or the fourth edition of the Diagnostic 
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Table 3 1 Risk of bias 

Risk of bias: outcome level 



Trial 


Risk of bias: 
trial level 


Remission 


Response 


Adverse 
events 


Withdrawals owing 
to adverse events 


014 


High* 


Highf 


Highf 


Highf 


Highf 


015 


Low 


Low 


Low 


Low 


Low 


016 


Low 


Low 


Low 


Low 


Low 


032 


Low 


Highf 


Highf 


Low 


Low 


043 


Low 


High* 


Highf 


Low 


Low 


045 


Low 


Low 


Low 


Low 


Low 


046 


Low 


Low 


Low 


Low 


Low 


047 


Low 


Low 


Low 


Low 


Low 


049 


Low 


Low 


Low 


Low 


Low 


050 


Low 


Low 


Low 


Low 


Low 


052 


Low 


Low 


Low 


Low 


Low 


091 


Low 


Low 


Low 


Low 


Low 


Berlanga and 
Flores-Ramos 
2006 


Low 


Highf 


Highf 


No data 


No data 



*High because of unclear randomisation, allocation concealment, and blinding. 

f High because of high risk of bias at trial level. 

f High because of violation of the intention to treat principle. 



and Statistical Manual of Mental Disorders. In the four fluox- 
etine controlled trials and in one citalopram controlled 
trial, the SSRIs were potentially underdosed compared 
with reboxetine (according to doses standardised on the 
basis of the maximum approved dose; see table 2). The 
trials were well balanced between treatment arms with 
respect to patient baseline characteristics. 

There were no major differences between trials in 
terms of dosage and mean patient age. However, 
there were differences in setting (inpatient, outpatient, 
or both) and baseline severity of depression as mea- 
sured by the Hamilton depression rating scale. For 
more details on trial characteristics see web table A. 

Risk of bias 

The overall methodological quality of the trials was 
good (table 3). At the trial level, the risk of bias was 
low in all but one study, which had a high risk of bias 
at the trial level owing to unclear allocation conceal- 
ment and blinding. At the outcome level, the risk of 
bias was low for all four benefit and harm outcomes in 
nine out of the 13 trials. Three trials had a high risk of 
bias at the outcome level owing to an inadequate inten- 
tion to treat analysis. Analyses excluding the outcomes 
at high risk of bias did not alter the conclusions (data not 
shown). As no clear dose-response relationship has 
been shown for fluoxetine and citalopram, 2425 the 
potential underdosing of these agents in five trials did 
not affect the risk of bias. 

Owing to the availability of a comprehensive set of 
the relevant data on reboxetine versus placebo and 
SSRIs, the risk of publication bias on the results of the 
final analysis was minor. 

Effects of interventions 

In this text, the terms "superior" and "inferior" refer to 
statistically significant differences between treatment 
groups (K0.05). 



Meta-analyses of remission and response rates 
The Hamilton depression rating scale was used in 
the meta-analyses of remission and response rates. 
No statistically significant difference between rebox- 
etine and placebo was noted in the meta-analysis of 
remission rates (OR 1.17, 95% CI 0.91 to 1.51; 
P=0.216;fig 2). 

Substantial heterogeneity (I 2 =67.3%; p=0.003) was 
shown in the meta-analysis of response rates including 
all eight trials that compared reboxetine with placebo, 
and consequently no point estimate was calculated. 
The only known inpatient trial — trial 091 (n=52), 
which had an OR of 11.43 (95% CI 3.10 to 42.12)— 
was obviously a statistical outlier (figure 2). 

In the sensitivity analysis using meta-regression ana- 
lysis, setting had an effect on the outcome response. 
Patients who received reboxetine in an inpatient set- 
ting were more likely to show a good response com- 
pared with placebo than were patients who received 
reboxetine in an outpatient setting (P=0.001 inpatients 
V outpatients; trials 091 v 049 and 050). In a second 
scenario, the proportion of inpatients was used as the 
independent variable. This analysis also included trials 
014 and 0 1 5, for which the proportion of inpatients was 
available from Montgomery et al 2003/ This scenario 
confirmed the influence of setting (P<0.001). The 
meta-analysis of response rates in the outpatient only 
trials (049 and 050) showed no statistically significant 
difference between reboxetine and placebo (OR 1.05, 
95% CI 0.73 to 1.50; P=0.796 P=0%). These findings 
indicate that patient setting was the most probable 
effect modifier. After exclusion of trial 091, the 
meta-analysis of response rates in the seven remaining 
trials showed no statistically significant difference 
between reboxetine and placebo (OR 1.24, 95% CI 
0.98 to 1.56, P=0.071, 1 2 =42.1%; figure 2). 

Reboxetine was inferior to SSRIs in the meta-analy- 
sis of remission rates (OR 0.80, 95% CI 0.67 to 0.96; 
P=0.015; fig 3). A similar, although non-significant, 
trend in remission rates was shown when reboxetine 
was compared with the individual SSRIs (fluoxetine, 
paroxetine, and citalopram). However, if remission 
rates according to the Montgomery-Asberg depression 
rating scale rather than the Hamilton depression rating 
scale were analysed from trials using this instrument as 
the primary scale (trials 046 and 047), reboxetine was 
inferior to paroxetine (OR 0.72, 95% CI 0.56 to 0.93). 
In the long term acute treatment trial (trial 043), rebox- 
etine was inferior to citalopram (OR 0.51, 95% CI 0.32 
to 0.83). However, the intention to treat principle was 
violated in this trial, so a worst case analysis was con- 
ducted in which the difference in remission rate com- 
pared with citalopram was no longer statistically 
significant. 

Reboxetine was also inferior to SSRIs in the meta- 
analysis of response rates (OR 0.80, 95% CI 0.67 to 
0.95; P=0.010). A similar trend was shown when 
reboxetine was compared with the individual SSRIs, 
where the trend reached statistical significance in the 
comparison of reboxetine and paroxetine (OR 0.79, 
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Trial 

Remission 

Fluoxetine 
014 
016 
050 
032 

Fluoxetine subtotal 
Subtotal heterogeneity: I 2 

Paroxetine 
046 
047 
052 

Paroxetine subtotal 



Reboxetine Selective serotonin 
(n/N) reuptake inhibitor (n/N) 



Odds ratio 
(95% CI) 



Weight Odds ratio 
(%) (95% CI) 



60/126 
51/79 

48/144 
14/38 
173/387 



57/127 
58/89 

66/144 
16/40 
197/400 



46.1%, P=0.311; subtotal effect: P=0.306 



132/252 
109/238 
69/152 
310/642 



152/243 
109/242 
89/164 
350/649 



Subtotal heterogeneity: r=40.8%, P=0.184; subtotal effect: P=0.104 



Citalopram 

Berlanga and Flores-Ramos 2006 12/42 



17/44 



Total 

Total heterogeneity: I 2 



495/1071 564/ 1093 

4.6%, P=0.395; total effect: P=0.015 



Response 

Fluoxetine 
014 
016 
050 
032 

Fluoxetine subtotal 
Subtotal heterogeneity: I 2 

Paroxetine 
046 
047 
052 

Paroxetine subtotal 
Subtotal heterogeneity: I 2 



70/126 
59/79 

60/144 
21/38 
210/387 



72/127 
64/89 

79/144 
23/40 
238/400 



■9.6%, P=0.345; subtotal effect: P=0.212 



144/252 
120/238 
80/152 
344/642 



156/243 
128/242 
100/164 
384/649 



■0.0%, P=0.644; subtotal effect: P=0.040 



Citalopram 

Berlanga and Flores-Ramos 2006 28/42 



33/44 



Total 582/1071 655/1093 -< 

Total heterogeneity: l 2 =0.0%, P=0.737; total effect: P=0. 010 0 2 q 0.33 0 50 1 
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Fig 3 1 Forest plot showing meta-analyses of remission and response rates for trials that compared reboxetine with selective 
serotonin reuptake inhibitors (SSRIs; fluoxetine, paroxetine, and citalopram). Empty boxes show published studies and filled 
boxes show unpublished studies. Empty diamonds show subtotals (individual SSRIs) and filled diamonds show overall totals 
(all SSRIs). CI, confidence interval; n, number of patients with event; N, number of patients in treatment group 



95% CI 0.64 to 0.99; P=0.04). In the long term acute 
treatment trial, no statistically significant difference 
was shown between reboxetine and citalopram (OR 
0.60, 95% CI 0.35 to 1.03). 

The overall findings were also reflected in the subset 
of trials that were both placebo controlled and SSRI 
controlled (n=4), which are suited to demonstrating 
assay sensitivity. The SSRIs were superior to placebo 
and reboxetine in this analysis, but no statistically sig- 
nificant difference was shown between reboxetine and 
placebo (see web figure A). 

Meta-analyses of adverse events and withdrawals owing to 
adverse events 

Reboxetine was inferior to placebo (that is, it was asso- 
ciated with higher event rates) in the meta-analyses of 
the rates of patients with at least one adverse event and 
in the meta-analysis of the rates of withdrawals owing 



to adverse events (OR 2.14, 95% CI 1.59 to 2.88; 
P<0.001 and OR 2.21, 95% CI 1.45 to 3.37; P<0.001, 
respectively; fig 4). 

The rates of patients with at least one adverse event 
did not differ significantly between patients treated 
with reboxetine and those who received an SSRI (OR 
1.06, 95% CI 0.82 to 1.36; P=0.667; fig 5). The same 
finding was seen for patients on reboxetine versus 
those treated with individual SSRIs. A meta-regression 
analysis showed a gender effect in the comparison of 
reboxetine with fluoxetine (P=0.022 for the interaction 
test) : in men reboxetine was inferior to fluoxetine in the 
meta-analysis of patients with at least one adverse 
event (OR 2.76, 95% CI 1.28 to 5.93), whereas no sig- 
nificant difference was shown in women (OR 0.90, 
95% CI 0.51 to 1.59). In the long term acute treatment 
trial, reboxetine was inferior to citalopram (OR 1.57, 
95% CI 1.03 to 2.38). 
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Trial 


Reboxetine 


Placebo 




(n/N) 


(n/N) 


Patients with adverse events 




014 


84/126 


78/128 


091 


24/28 


13/28 


015 


71/112 


58/112 


046 


239/264 


208/254 


047 


225/258 


201/252 


050 


138/150 


117/150 


045 


68/89 


52/87 


049 


98/106 


77/104 


Total 


947/1133 


804/1115 


Total heterogeneity: I 2 


=44.0%, P=0.085; total effect: P<0.001 


Withdrawal owing to adverse events 




014 


14/126 


15/128 


091 


1/28 


1/28 


015 


11/112 


7/112 


046 


26/264 


9/254 


047 


20/258 


10/252 


050 


27/150 


12/150 


045 


15/89 


7/87 


049 


23/106 


3/104 


Total 


137/1133 


64/1115 



Total heterogeneity: l 2 =38.4%, P=0.124; total effect: P<0.001 




Weight 


Odds ratio 


(%) 


(95% CI) 


15.8 


1.28 (0.77 to 2.14) 


4.5 


6.92 (1.90 to 25.23) 


15 2 


1 61 CO 95 tn 1 751 


15.5 


2.11 (1.26 to 3.56) 


16.8 


1.73 (1.07 to 2.79) 


11.1 


3.24 (1.60 to 6.57) 


12.3 


2.18 (1.14 to 4.18) 


8.8 


4.30 (1.85 to 9.99) 


100.00 


2.14 (1.59 to 2.88) 


15.9 


0.94 (0.43 to 2.04) 


2.1 


1.00 (0.06 to 16.82) 


12.0 


1.63 (0.61 to 4.38) 


15.8 


2.97 (1.36 to 6.48) 


15.8 


2.03 (0.93 to 4.44) 


17.1 


2.52 (1.23 to 5.20) 


12.5 


2.32 (0.89 to 6.00) 


8.7 


9.33 (2.71 to 32.16) 


100.00 


2.21 (1.45 to 3.37) 



0.10 0.33 0.50 
Control worse 



2 3 10 
Reboxetine worse 



Fig 4 1 Forest plot showing meta-analyses of rates of patients with at least one adverse event and rates of withdrawals owing 
to adverse events for trials that compared reboxetine with placebo. Empty boxes show published studies and filled boxes 
show unpublished studies. CI, confidence interval; n, number of patients with event; N, number of patients in treatment group 



Substantial heterogeneity (I 2 =67.4°/o) was shown in 
the meta-analysis of the rates of withdrawals owing to 
adverse events in the comparison between reboxetine 
and SSRIs, which was in part owing to variations in the 
results of the individual SSRIs. The comparison 
between reboxetine and fluoxetine showed low hetero- 
geneity (I 2 =19.3°/o) and statistically significantly more 
withdrawals owing to adverse events for reboxetine 
(OR 1.79, 95% CI 1.06 to 3.05; P=0.031). On the 
other hand, the comparison between reboxetine and 
paroxetine showed substantial heterogeneity 
(I 2 =84.2%), but the sensitivity analysis did not identify 
a potential effect modifier. We therefore concluded 
that there was no proof of a difference between rebox- 
etine and paroxetine concerning rates of withdrawals 
owing to adverse events. In the long term acute treat- 
ment trial, reboxetine was inferior to citalopram (OR 
4.61, 95% CI 2.15 to 9.89). 

Further information on adverse events 
The rates of serious adverse events (including events 
related to suicide) were low and did not differ signifi- 
cantly between reboxetine and placebo or reboxetine 
and SSRIs (data on overall serious adverse events not 
shown). A total of 18 serious adverse events related to 
suicide (suicidal tendencies, suicide attempts, or com- 
pleted suicides) were noted (six for reboxetine; four for 
placebo; eight for SSRIs). One death (a completed sui- 
cide under placebo) was reported, which was the only 
mortality in the study arms investigated. However, 
with respect to study design and duration, none of the 
trials were aimed at investigating suicide related events 
or overall mortality. The validity of the results of these 
outcomes is therefore limited and the data do not pro- 
vide clarification. 



Publication bias 

A substantial proportion of patient data (74%) had not 
been previously published: 86% (1946/2256 patients) 
in the comparisons of reboxetine and placebo and 67% 
(1760/2641 patients) in the comparisons of reboxetine 
and SSRIs (table 1). 

For both benefit outcomes, the addition of unpub- 
lished data changed the superiority of reboxetine versus 
placebo shown in published data to a non-significant dif- 
ference and also changed the non-significant difference 
between reboxetine and SSRIs to an inferiority of rebo- 
xetine (fig 6). Comparison of the published data with the 
full dataset (published and unpublished) showed that the 
published data overestimated the beneficial effect of 
reboxetine compared with placebo by 99-1 15% and of 
reboxetine compared with SSRIs by 19-23%. 

For both harm outcomes, the addition of unpub- 
lished data changed the non-significant difference 
between reboxetine and placebo shown in published 
data to an inferiority of reboxetine. For rates of with- 
drawals owing to adverse events, the addition of 
unpublished data changed the non-significant differ- 
ence between reboxetine and fluoxetine to an inferior- 
ity of reboxetine; this was primarily owing to the 
increased power of the analysis rather than to major 
differences in withdrawal rates between published 
and unpublished data. For patients with at least one 
adverse event, no significant impact of unpublished 
data was shown in the comparison between reboxetine 
and SSRIs. 

DISCUSSION 

To our knowledge, this is the first systematic review of 
a comprehensive evidence base of published and 
unpublished acute treatment trials of reboxetine versus 
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Trial Reboxetine 
(n/N) 

Patients with adverse events 

Fluoxetine 

014 84/126 
016 53/79 
050 138/150 
032 37/43 

Fluoxetine subtotal 312/398 

Subtotal heterogeneity: 



Selective serotonin 
reuptake inhibitor (n/N) 



81/127 
60/89 

129/150 
33/42 

303/408 



Odds ratio 
(95% CI) 



Weight 

(%) 



0.0%, P=0.565; subtotal effect: P=0.192 



Paroxetine 
046 
047 
052 

Paroxetine subtotal 
Subtotal heterogeneity: 

Total 

Total heterogeneity: I' 



239/264 
225/258 
115/157 
579/679 



231/262 
238/260 
125/166 
594/688 



l 2 =34.6%, P=0.217; subtotal effect: P=0.600 

891/1077 897/1096 
= 14.8%, P=0.317; total effect: P=0.667 



Withdrawal owing to adverse events 

Fluoxetine 

014 14/126 

016 9/79 

050 27/150 

032 5/43 

Fluoxetine subtotal 55/398 



10/127 
6/89 

10/150 
6/42 

32/408 



Subtotal heterogeneity: I =19.3%, P=0.294; subtotal effect: P=0.031 



Paroxetine 

046 26/264 

047 20/258 
052 29/157 

Subtotal heterogeneity: l 2 =84.2%, P=0.002 
Total heterogeneity: l 2 =67.4%, P=0.005 



22/262 
31/260 
10/166 




0.10 0.33 0.50 1 2 3 10 
Control worse Reboxetine worse 
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(95% CI) 



19.0 


1 
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90 (0.61 to 1.33) 



100.00 1.06 (0.82 to 1.36) 



1.46 (0.62 to 3.43) 
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1.79 (1.06 to 3.05) 
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Fig 5 1 Forest plot showing meta-analyses of rates of patients with at least one adverse event and rates of withdrawals owing to 
adverse events for trials that compared reboxetine with selective serotonin reuptake inhibitors (SSRIs; fluoxetine and 
paroxetine). Empty boxes show published studies and filled boxes show unpublished studies. Empty diamonds show subtotals 
(individual SSRIs) and filled diamonds show overall totals (all SSRIs). CI, confidence interval; n, number of patients with event; 
N, number of patients in treatment group 



placebo or SSRIs in adults with major depressive dis- 
order. We found that, overall, reboxetine was ineffec- 
tive as an antidepressant because it showed no benefit 
over placebo and was inferior to SSRIs for remission 
and response rates. A benefit of reboxetine (higher 
response rates) was shown in a placebo controlled 
trial in inpatients; however, this trial was too small to 
draw general conclusions on the effect of reboxetine in 
this patient population. Reboxetine was inferior to pla- 
cebo for both harm outcomes and to fluoxetine for 
rates of withdrawals owing to adverse events. 

Given the potential underdosing of fluoxetine and 
citalopram in five trials, our findings on reboxetine 
might be considered conservative. At the same time, 
the advantages of SSRIs concerning harm might be 
overestimated. However, as stated, no clear dose- 
response relationship has been shown for fluoxetine 
and citalopram. 242,5 Furthermore, in our test of assay 
sensitivity that included two of the four potentially 
underdosed fluoxetine arms, even the lower fluoxetine 
dose showed a clear benefit compared with placebo 
(OR 1.98, 95% CI 1. 19 to 3.28, I 2 =53.8%), thus qualify- 
ing the effect of dosing in treatment for depression. 



Data on 74% of the patients included in our analysis 
was unpublished, indicating that the published evi- 
dence on reboxetine so far has been severely affected 
by publication bias. Our comparison of published and 
unpublished trials confirmed this assumption: the posi- 
tive benefit-risk ratio of reboxetine in the published 
literature was changed to a negative ratio if unpub- 
lished trials were added to the analysis. 

Comparison with other reviews 

The results of our review largely contradict the findings 
of previous systematic reviews and analyses of rebox- 
etine versus placebo 679 and reboxetine versus active 
comparators. 8911 

The solely placebo controlled analyses by Ferguson 
et al 6 and Montgomery et al 7 both found greater effi- 
cacy (including higher response rates) for reboxetine 
compared with placebo, and Ferguson et al also found 
comparable harms. However, both reviews included 
only three of the eight studies considered in our review 
(plus the inpatient trial by Ban et al 1998 2b ). These two 
reviews also included only one unpublished trial (015), 
even though the relevant unpublished trials had been 
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Reboxetine 
(n/N) 



Placebo or selective 
serotonin reuptake 
inhibitor (n/N) 



Odds ratio 
(95% CI) 



Reboxetine v placebo 






Remission 






Published (1) 


60/126 


34/128 


Unpublished (6) 


395/938 


379/930 


Total (7) 


455/1064 


413/1058 


Response 






Published (1) 


70/126 


43/128 


Unpublished (6) 


469/938 


439/930 


Total (7) 


539/1064 


482/1058 


Patients with adverse events 




Published (2) 


108/154 


91/156 


Unpublished (6) 


839/979 


713/959 


Total (8) 


947/1133 


804/1115 


Withdrawal owing to adverse events 




Published (2) 


15/154 


16/156 


Unpublished (6) 


122/979 


48/959 


Total (8) 


137/1133 


64/1115 


Reboxetine v selective serotonin reuptake inhibito 


Remission 






Published (3) 


123/247 


132/260 


Unpublished (5) 


372/824 


432/833 


Total (8) 


495/1071 


564/1093 


Response 






Published (3) 


157/247 


169/260 


Unpublished (5) 


425/824 


486/833 


Total (8) 


582/1071 


655/1093 


Patients with adverse events 




Published (2) 


137/205 


141/216 


Unpublished (5) 


754/872 


756/880 


Total (7) 


891/1077 


897/1096 


Withdrawal owing to adverse events* 




Published (2) 


23/205 


16/216 


Unpublished (2) 


32/193 


16/192 


Total (4) 


55/398 


32/408 



For remission/response 



For patients with adverse events and withdrawals 
owing to adverse events 



0.20 0.33 0.50 



Control 
better 



Control 
worse 



Odds ratio Ratio of odds ratios; Publication 
(95% CI) published:unpublished bias(%) 
(95% CI) 
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1.06 (0.88 to 1.28) 
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-»- 2.67 (0.52 to 13.79) 
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Fig 6 1 Forest plot showing meta-analyses of published, unpublished, and all trials. Publication bias (right column) is presented 
as the ratio of odds ratios of published results versus overall results. The extent of publication bias is expressed as 
percentage change between the analysis of published trials only and the analysis of all trials (that is, publication 
bias=100x(ORp Ublished data/ORtotai data-1))- *Fluoxetine controlled studies only 



completed before publication of these analyses and 
both reviews were cowritten by a sponsor employee. 
The meta-analysis by Chuluunkhuu et al 9 concluded 
that reboxetine showed superior efficacy to placebo 
and found no difference in efficacy of reboxetine com- 
pared with SSRIs and other antidepressants. However, 
this analysis considered only published data. 

Although the meta-analysis by Papakostas et al 8 
identified and included a large body of unpublished 
studies that used SSRIs as the control (the same set as 
we used), they found no significant difference in 
response rates between SSRIs and reboxetine (risk 
ratio 1.08, 95% CI 0.98 to 1.19). Their analysis 
included the long term acute treatment trial 043, 
which we analysed separately. In contrast, our analysis 
showed that reboxetine was inferior to SSRIs, even if 
trial 043 was included (recalculated according to Papa- 
kostas: risk ratio (SSRI » reboxetine) 1.10, 95% CI 1.03 
to 1.17; P=0.003). The reason for this discrepancy is 



unclear, because Papakostas et al reported only point 
estimates and CIs and did not report the number of 
actual events or the corresponding populations. 

The widely discussed systematic review by Cipriani 
et al, 11 which assessed 12 new generation anti- 
depressants in a network meta-analysis and ranked 
reboxetine last, had similar findings to those of our 
review. These authors found significantly lower 
response rates for reboxetine than for all SSRIs inves- 
tigated, as well as significantly higher dropout rates 
versus fluoxetine, citalopram, escitalopram, and ser- 
traline. However, despite the similarity in findings, 
the evidence base of the Cipriani review differed mark- 
edly from that in our review because placebo con- 
trolled trials were omitted and trials that were not 
double blind, which carry a higher risk of bias, were 
considered. In addition, unpublished trials of reboxe- 
tine on file at the manufacturers were not considered, 
even though significant publication bias has been 
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Table 4 1 Examples of publication bias and industry sponsorship bias in trials of antidepressants 



Source 


Study type 


Antidepressant type 


Findings 


Turner etal2008 33 


Comparison of FDA reviews 
and matching publications 


SSRIs, SNRIs, NDRIs, TeCAs, 
and atypical 
antidepressants 


"Among 74 FDA registered studies, 31%, accounting for 3449 study participants, were not published . 
. . A total of 37 studies viewed by the FDA as having positive results were published . . . Studies viewed 
by the FDA as having negative or questionable results were, with 3 exceptions, either not published 
(22 studies) or published in a way that, in our opinion, conveyed a positive outcome (11 studies). 
According to the published literature, it appeared that 94% of the trials conducted were positive. By 
contrast, the FDA analysis showed that 51% were positive ... the increase in effect size ranged from 
11% to 69% for individual drugs and was 32% overall." 


Kirsch etal 2008 63 


Meta-analysis of data 
submitted to the FDA 


SSRIs, SNRIs, and atypical 
antidepressants 


"[T]he FDA public disclosure did not include mean changes for nine trials that were deemed adequate 
and well controlled but that failed to achieve a statistically significant benefit for drug over placebo . . . 
Specifically, four sertraline trials involving 486 participants and one citalopram trial involving 274 
participants were reported as having failed to achieve a statistically significant drug effect, without 
reporting mean Hamilton rating scale of depression scores. We were unable to find data from these 
trials on pharmaceutical company websites orthrough our search of the published literature. These 
omissions represent 38% of patients in sertraline trials and 23% of patients in citalopram trials." 


Whittington et al 2004 34 


Systematic review of 
published versus 
unpublished data 


SSRIs, SNRIs 


"Data for two published trials suggest that fluoxetine has a favourable risk-benefit profile, and 
unpublished data lend support to this finding. Published results from one trial of paroxetine and two 
trials of sertraline suggest equivocal orweak positive risk-benefit profiles. However, in both cases, 
addition of unpublished data indicates that risks outweigh benefits. Data from unpublished trials of 
citalopram and venlafaxine show unfavourable risk-benefit profiles." 


Melanderetal 2003 38 


Analysis of industry 
sponsored studies in new 
drug applications 


SSRIs 


"Multiple publication: 21 studies contributed to at least two publications each, and three studies 
contributed to five publications. Selective publication: studies showing significant effects of drug 
were published as stand alone publications more often than studies with non-significant results. 
Selective reporting: many publications ignored the results of intention to treat analyses and reported 
the more favourable per protocol analyses only." 


Jureidini et al 2008 64 


Case report on selective 
reporting 


Paroxetine 


"The published report of study 329 of paroxetine in adolescents sponsored by GlaxoSmith Kline claims 
that 'paroxetine is generally well tolerated and effective for major depression in adolescents.' By 
contrast, documents obtained during litigation reveal that study 329 was negative for efficacy on all 
eight protocol specified outcomes and positive for harm." 


Tungaraza et al 2007 65 


Analysis of influence of 
industry authorship and 
funding 


Not specified* 


"Independent studies were more likely to report negative findings than were industry funded studies. 
However, the involvement of a drug company employee had a much greater effect on study outcome 
than financial sponsorship alone." 


Perlisetal2005 66 


Analysis of influence of 
industry funding and 
financial conflict of interest 


Not specified* 


"Among the 162 randomised, double blind, placebo controlled studies examined, those that reported 
conflict of interest were 4.9 times more likely to report positive results; this association was significant 
only among the subset of pharmaceutical industry funded studies." 


Kelly eta!2006 67 


Analysis of influence of 
industry funding 


Not specified* 


"Favourable outcomes were significantly more common in studies sponsored by the drug 
manufacturer (78%) than in studies without industry sponsorship (48%) or sponsored by a competitor 
(28%)." 


*Findings also refer to other psychiatric drugs. All analyses examined drug trials reported in psychiatric journals. No separate results for antidepressants were reported. 

FDA, Food and Drug Administration; NDA, new drug application; NDRI, norepinephrine and dopamine reuptake inhibitor; SNRI, serotonin and norepinephrine reuptake inhibitor; SSRI, 

selective serotonin reuptake inhibitor; TeCA, tetracyclic antidepressant. 



shown in antidepressant research. Given the sources of 
bias noted, the results of the Cipriani review should be 
interpreted with caution. 

Our findings that reboxetine was superior (higher 
response rates) to placebo in a small trial in inpatients 
and that patient setting was a probable effect modifier 
are supported by the four week active controlled and 
placebo controlled inpatient trial by Ban et al 2(> (n=169 
in the reboxetine and placebo arms), which we 
excluded owing to its short duration. Ban et al also 
found a statistically significant higher response rate in 
inpatients who received reboxetine compared with 
those who received placebo (60% v 35%; OR 2.70, 
95% CI 1.45 to 5.03 (own calculation)). 

Strengths and limitations of the review 

The main strength of our review is the inclusion of a 
large amount of previously unpublished data. As we 
made extensive efforts to identify unpublished trials, 
we are optimistic that we analysed the vast majority 
or even all of the placebo controlled and SSRI con- 
trolled double blind randomised trials of reboxetine 
in adults with major depression. 



Our review also has a number of limitations. We 
only had access to aggregated data. To assess the 
impact of effect modifiers, meta-analysis of individual 
patient data would be needed to determine the setting 
in studies with mixed settings and to test our hypothesis 
that the setting was the effect modifier explaining the 
substantial heterogeneity in the meta-analysis of 
response rates in placebo controlled trials. 

Our results are further limited by the fact that they 
only refer to acute treatment trials, only one of which 
lasted more than eight weeks. However, six to eight 
weeks is the standard study duration in trials investigat- 
ing the acute treatment of depression. The long term 
acute treatment trial showed similar, though not 
always statistically significant, trends to the short term 
trials. Other long term outcomes in depression, such as 
prevention of relapse or recurrence, were not the focus 
of this paper. 

Finally, except for a subgroup analysis for gender and 
setting, we assessed total populations of patients with 
major depressive disorder. No analyses were performed 
in other subgroups of patients (for example, patients 
with severe disease or specific major depressive 
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WHAT IS ALREADY KNOWN ON THIS TOPIC 

Reboxetine has been approved for the treatment of major depression in many European 
countries, but the application for approval was rejected in the United States 

Doubts have been raised about the efficacy of reboxetine 

Research into antidepressants is particularly affected by publication bias 

WHAT THIS STUDY ADDS 

Overall, reboxetine is not effective for the treatment of major depressive disorder 

We found a higher rate of patients affected by adverse events than with placebo and higher 
withdrawal rates owing to adverse events than with placebo and fluoxetine 

This meta-analysis provides a striking example of publication bias, in which the previously 
favourable risk-benefit profile of reboxetine shown in published trials is reversed by the 
addition of unpublished data 

Post-approval regulatory decisions (for example, reimbursement decisions based on the 
findings of health technology assessment reports) might be affected by publication bias 

Our findings underline the need for mandatory publication of clinical trial results 



disorder symptoms such as anxiety or cognitive impair- 
ment), in which treatment effects may differ. 

Publication bias 

Our difficulties in retrieving unpublished trial data and 
our results of the comparison between published and 
previously unpublished trials are a further example of 
publication bias, a problem that has been known in 
clinical research for decades. 2731 A recent narrative 
review has shown that publication bias affects a wide 
range of medical indications and interventions.' 12 Such 
bias, including industry sponsorship bias, has fre- 
quently been identified in research on antidepressants 
(table 4). For example, Turner et al 33 published a com- 
parison of FDA reviews of placebo controlled anti- 
depressant trials and matching publications, which 
showed that, overall, published trials overestimated 
effect sizes by 32% (11 to 69% for individual agents); 
the estimates in our review were even higher. Whit- 
tington et al 34 investigated SSRIs in the treatment of 
childhood depression and found that the addition of 
unpublished data reversed the benefit-risk profile for 
all but one SSRI. 

In addition to publication bias, outcome reporting 
bias has been identified as a major problem in the 
reporting of clinical trials, resulting in a distorted pub- 
lic record of an intervention. 35 38 Our review also iden- 
tified this type of bias — for three reboxetine trials, only 
results on subpopulations or selected outcomes were 
available in the published literature (trials 047, 050, 
052; table 1). 

The more positive benefit-risk ratio in published 
data compared with unpublished data also affects the 
content of clinical guidelines. For example, the 
National Institute for Health and Clinical Excellence 
(NICE) guideline on the treatment and management of 
depression in adults is based on published studies of 
reboxetine, and concludes that "Reboxetine is super- 
ior to placebo and as effective as other antidepressants 



in the treatment of depression." 10 In our opinion, this 
conclusion can no longer be upheld. 

The ongoing problem of publication bias shows that 
unbiased decision making in health care requires man- 
datory public disclosure of all clinical trial data. The 
US FDA Amendments Act of 2007 39 solves the pro- 
blem in part by requiring protocol information and 
study results for clinical trials to be made public on 
the clinicaltrials.gov website (www.clinicaltrials.gov; 
please see accompanying comment (doi:10.1136/ 
bmj.c4942) for further details). Similar legislation is 
also being introduced in Europe, with the mandatory 
public disclosure of data from the clinical trials data- 
base EudraCT (eudract.ema.europa.eu), 4041 but the 
date of implementation is not yet clear. 

As the full assessment reports on reboxetine pre- 
pared by regulatory authorities are not publicly avail- 
able, it is not clear as to how the comprehensive body 
of evidence (including that on efficacy outcomes) gen- 
erated after reboxetine was approved in Europe in the 
late 1990s has been analysed by these authorities. The 
reason for the difference in approval status of reboxe- 
tine between Europe and the US thus remains unclear. 

Conclusions and policy implications 

Our analysis of a comprehensive evidence base of pub- 
lished and unpublished trials of reboxetine compared 
with placebo or SSRIs in adults with major depressive 
disorder indicates that reboxetine is, overall, an inef- 
fective and potentially harmful antidepressant. Pub- 
lished evidence on reboxetine has been substantially 
affected by publication bias, underlining the urgent 
need for mandatory publication of clinical trial data, 
including data on older agents. 
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